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SPECIFICATION 

CROSS-REFERENCE TO RELATED APPLICATIONS 

: The-preseifappti eation i3 related^ the f o ll o wing copending pa tent a pplications wliicfa 
were filed on October 14, 1998 and Ivtfoch are incorporated herein in their entirety by reference: 
(i) Patent Application S/N 09/1 7^583 entitled "Robust Watermark Method and Apparatus for 
Digital Signals" by Earl Leykie; (ii) Patent Application S/N 09/172,936 entitled "Robust 
Watermark Method anjKApparatus for Digital Signals" by Earl Levine and Jason S. Brownell; 
(iii) Patent Applkafion S/N 09/172,935 entitled "Robust Watermark Method and Apparatus for 
Digital Signer by Earl Levine; (iv) Patent Application S/N 09/172,937 entitled "Secure 
Watermjdc Method and Apparatus for Digital Signals" by Earl Levine; and (v) Patent 
Application S/N 09/172,922 entitled "Efficient Watermark Method and Apparatus for Digital 
Jg^ gnals" by Earl Lovinc. — 



FIELD OF THE INVENTION 

The present invention relates to digital signal processing.and, in particular, to a 
particularly robust and efficient watermark mechanism by which identifying data can be encoded 
into digital signals such as audio or video signals such that the identifying data are not 
perceptible to a human viewer of the substantive content of the digital signals yet are retrievable 
and are sufficiently robust to survive other digital signal processing. 



BACKGROUND OF THE INVENTION 

Video and audio data have traditionally been recorded and delivered as analog signals. 
However, digital signals are becoming the transmission medium of choice for video, audio, 
audiovisual, and multimedia information. Digital audio and video signals are currently delivered 
widely through digital satellites, digital cable, and computer networks such as local area 
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networks and wide area networks, e.g., the Internet. In addition, digital audio and video signals 
are currently available on digital media such as audio compact discs, digital audio tape (DAT), 
minidisc, and laserdisc and digital video disc (DVD) video media. As used herein, a digitized 
signal refers to a digital signal whose substantive content is generally analog in nature, i.e., can 
be represented by an analog signal. For example, digital video and digital audio signals are 
digitized signals since video images and audio content can be represented by analog signals. 

A significant disadvantage resulting from the current tremendous growth of digitally 
stored and delivered audio and video is that digital copies which have exactly the same quality as 
the original digitized signal can easily be made and distributed without authorization 
notwithstanding illegality of such copying. The substantive content of digitized signals can have 
significant proprietary value which is susceptible to considerable diminution as a result of 
unauthorized duplication. 

It is therefore desirable to include identifying data in digitized signals having valuable 
content such that duplication of the digitized signals also duplicates the identifying data and the 
source of such duplication can be identified. The identifying data should not result in humanly 
perceptible changes to the substantive content of the digitized signal when the substantive 
content is presented to a human viewer as audio and/or video presentations. Since substantial 
value is in the substantive content itself and in its quality, any humanly perceptible degradation 
of the substantive content substantially diminishes the value of the digitized signal. Such 
imperceptible identifying data included in a digitized signal is generally known as a watermark. 

In general, adding a watermark to a digitized signal requires significant resources, often 
exceeding the capacity of server computer systems which deliver digitized signals to individual 
purchasers. In particular, such server computer systems are typically required to deliver many 
digitized products simultaneously and have insufficient resources to also add watermarks to those 
digitized signals prior to, or during, delivery. As a result, watermarks are typically added once by 
a publishing computer system and the watermarked digitized signal is placed on the server 
computer system for delivery. The primary disadvantage of such a system is that all copies of a 
watermarked digitized signal have identical watermark data. Accordingly, a source of 
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unauthorized copies of a watermarked digitized signal cannot generally be determined from such 
a watermark. 

What is needed, therefore, is a watermark system in which identifying data can be 
securely and robustly included in a digitized signal in a particular efficient manner such that a 
5 server computer system can add such data for each delivery of the digitized signal. 



v v SUMMARY OF THE INVENTION 

10 tr rncroFdanc^^ signaHvhkh is u s e d to watermarks 

digitized analog signal (the subjec^ignal) is predetermined to enable embedding of transaction- 

;C specific watermark data to be^mbedded in the subject signal with minimal processing resources. 

m Since the basis signal g^rally accounts for the majority of the processing resources required to 
watermark the sub^t signal, only a relatively small portion of the requisite processing resources 

;S are used to embed transaction-specific watermark into the subject signal. The transaction- 
specific j^ennark data is specific to a particular delivery of the digitized signal such that 

^ unau0K)rized copies can identify an authorized copy of the signal from which the unauthorized 

|3 ©spterweie made;- 

\Q From the basis signal and the subject signal, two signal streams are created: one 

it) representing a first logical value, e.g., a logical "0", embedded into the subject signal and one 
representing a second logical value, e.g., a logical "1", embedded into the subject signal. The 
two signal streams are divided into segments and the segments are combined into a composite 
signal. 

The composite signal can be constructed of composite frames, each of which includes 
25 frames constructed of segments of each of the two signal streams. The frames of a composite 
frame represented various permutations of overlapping segments of the two signal streams. For 
example, if a particular composite frame corresponds to two consecutive segments of the subject 
signal and thus two consecutive segments of the two signal streams, the composite frame can 
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include four frames in which the two corresponding segments represent the following respective 
logical values: (i) "0" and "0", (ii) "0" and "1", (iii) "1" and "0", and (iv) "1" and "1". In 
forming a watermarked version of the subject signal to embed therein a watermark signal 
corresponding to transaction-specific data, the transaction specific data is mapped to the 
composite signal and, specifically to the composite frame. The one of the frames of the 
composite frame t which corresponds to the transaction specific data is selected and included in 
the watermarked signal. As a result, the quick watermarking process is reduced to simply 
forming transaction-specific data and selecting pre-existing frames according to the transaction- 
specific data. Relatively little processing resources are required. 

In addition, the frames of a composite frame can be compressed such that the 
watermarked signal is compressed when assembled from the compressed frames of the various 
composite frames. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 is a block diagram of a digital signal distribution system which uses transaction- 
specific watermarking in accordance with the present invention. 

Figure 2 is a block diagram of a server computer system of the distribution system of 
Figure 1 . 

Figure 3 is a block diagram of a first embodiment of a quick watermarker of the server 
computer system of Figure 2 in accordance with the present invention. 

Figure 4 is a block diagram of a publisher process in accordance with a second 
embodiment of the present invention. 

Figure 5 is a block diagram of a composite signal builder of the publisher process of 
Figure 4. 

Figure 6 is a logic flow diagram of the building of composite frames by the composite 
signal builder of Figure 5. 

Figure 7 is a block diagram illustrating the building of composite frames by the 
composite signal builder of Figure 5. 
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Figure 8 is a logic flow diagram of the packing of composite frames by a composite frame 
packer of Figure 7. 

Figure 9 is a block diagram illustrating the alignment of segment and frame boundaries. 
Figure 10 is a block diagram of a quick watermarker in accordance with the second 
embodiment of the present invention. 

Figure 1 1 is a block diagram of a frame selector of the quick watermarker of Figure 10. 

DETAILED DESCRIPTION 

In accordance with th e pre s ent myention, a digit i zed signal is publislied ' willi a bl a n k 
watermark, i.e., a watermark whiphfeontains no specific watermark data, and a server computer 
system encodes specific wajefmark data into the watermark signal for each delivery of the 
digitized signal. Sinc^rfvery small portion of processing resources required to produce a 
wa t erma rk ed d igif ; m > d signal, th e^woi kluad of die sci vci lu mputei system is i , e tatrveiy4tght: — 

Distribution System 100 

A brief overview of a digital product distribution system 100 is helpful. A publisher 
computer system 102 produces a digital product 122, which is a digitized analog signal in this 
embodiment. Publisher computer system 102 also includes a publisher process 120 which sends 
digital product 122 through a wide area computer network 108 to a server computer system 104 
for subsequent distribution. In accordance with the present invention, publisher process 120 also 
prepares a watermark basis signal for use by server computer system 104 in subsequently 
encoding watermark data using the basis signal to form a watermarked digital product. 

Server computer system 104 includes a server process 140 which receives digital product 
122 and the watermark basis signal prepared by publisher process 120 and stores both in digital 
product datastore 142. Server process 140 also receives requests for digital products through 
wide area computer network 108 from client computer systems such as client computer system 
106. In response to a particular request for a digital product, server process 140 selects data 
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unique to the request and uses such data to encode a unique watermark for the requested digital 
product for that particular request. Server computer system 104 includes a quick watermarker 
144 (Figure 2) which performs the watermark data encoding and which adds the watermark to 
the requested digital product. Server process 140 sends the watermarked digital product to the 
request client computer system. Quick watermarker 144 is described more completely below and 
requires substantially fewer processing resources than conventional, complete watermarking 
systems such that server computer system 104 can serve many concurrent requests each of which 
requires watermarking of a respective digital product. 

Client computer system 106 (Figure 1) includes a player 160 which is all or part of one or 
more computer processes and presents the substantive content of the requested and received 
digital product 162. Because of the processing by server process 140, digital product 162, 
although derived from digital product 122, is distinctly watermarked relative to all other digital 
products derived from digital product 122. As a result, all unauthorized copies of digital product 
162 can be traced back to digital product 162 and therefore to the user of client computer system 
106. 

A first embodiment of quick watcrmaifccr 111 (Figure 2) is shown as quick w ategmagkef 
144 A (Figure 3). In this illustrative embodiment, quick watermarker 144 A retrieves both the 
requested digital product, e.g., sublet digital product signal 302, and a corresponding basis 
signal 304 which is previousjy'aerived from subject digital product signal 302. Generation of a 
watermark basis signal frdm a digitized signal is described more completely in U.S. Patent 
Application S/N 09/172,936 entitled "Robust Watermark Method and Apparatus for Digital 
Signals" filec^m October 14, 1998 by Earl Levine and Jason S. Brownell (hereinafter the "'936 
Application") and that description is incorporated herein by reference. In this embodiment, 
^ ubpet digital product s i gnal 102 and hnnin nign n l I fM qyg iinmm pre«sfri^ 

Qui ck w alcim aik c rl l'I A uk u inoluc^ s- a - bit str e am generator 306 whidi deiives fmrn — 
unique transaction data 308 a stream of#it stream segments 310. Bit stream segments 310 define 
the manner in which unique transaction data 308 are represented using basis signal 304. In this 
embodiment, each segment of hit stream segments 310 represents whether a corresponding 
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portion of basis signal 304 is to be added to or^ufJtracted from a corresponding portion of subject 
digital product signal 302. In addition, epdn segment of bit stream segments 310 specifies 
tapering of basis signal 304 at segrpdnt boundaries to avoid audible effects at segment boundaries 
in the resulting wateimarkecj^ignal. Furthermore, bit stream generator 306 pre-code, 
convolutionally enco<tesfand cyclically scrambles unique transaction data 308 to reduce the 
likelihood that th^esulting watermark can be detected, decoded, and/or removed without proper 
authorization/The segmenting, tapering of segment boundaries, pre-coding for inversion 
robusto^C convolutional encoding, and cyclical scrambling are all described more completely in 
^■ A p plication an dthat des cription is imuipuratcd heiein by lefeience. ^ 
1 0 Quick watermarker 1 44A multiplies basis signal 304 and bit stream 3 1 0 using multiplier 

m 3 1 8 and adds the resulting product to subject digital product signal 302 using adder 320 to 
jfl produce watermarked digital product signal 3 1 2. Since the majority of processing required to 
gg form watermarked digital product signal 3 12 is in forming basis signal 304 from subject digital 
:~ product signal 302 and since basis signal 304 is formed prior to receipt by quick watermarker 
§S 144 A, formation of watermarked digital product signal 312 requires relatively little processing 
; " resources. Accordingly, watermarking of subject digital product signal 302 can be performed by 

server computer system 104 (Figure 1) and can therefore use unique data for each transaction 
O served as unique transaction data 308 (Figure 3). Thus, any unauthorized copies of watermarked 
:fj digital product signal 312 can be traced to a specific purchaser. 

26 Quick watermarker 144 A includes a compressor 314 which compresses watermarked 

digital product signal 312 using conventional techniques to form a compressed watermarked 
product signal 316 which is ready for delivery through wide area computer network 108 (Figure 
1). 

Iftra- more complex a nd m or e efficie nt . S Bbo ffm miU publis linrpmr fs s 1?0 pe r f o rm? ]- - 
compression processing in addition to formatioa^f a basis signal corresponding to the subject 
digital product signal. Referring to Figure ^publisher process 120 includes a blank watermarker 
406 which in turn includes a basis sign^Kgenerator 408. Basis signal generator 408 receives a 
subject digital product signal 402 apd produces therefrom a basis signal 404 in the manner 
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described more completely in the^93tf Application and that description is incorporated herein by 
reference. Blank watenn^ric6r 106 also includes segment windowing logic 410 which divides 
basis signal 404 inj^logic segments and tapers basis signal 404 at segment boundaries to prevent 
audible effep&at basis signal boundaries. Division into segments and tapering at segment 
5 boundaries are described more completely in the '936 Application and that description is 
kigmporated her e in by refer e nce . 

Blank watermarker 406 produces two (2) digital signal streams, one representing a stream 
of logical "1" bits and one representing a stream of logical "0" bits. As described more 
completely below, portions of these two streams can be combined to form a watermarked digital 
1 0 product signal with a watermarked signal representing whatever watermark data is desired. Blank 
m watermarker 406 includes an adder 412 which adds segmented basis signal from segment 
|fl window logic 410 to subject digital product signal 402. Blank watermarker 406 similarly 
jjj includes a subtracter 414 which subtracts segmented basis signal of segment window logic 410 
!j from subject digital product signal 402. 

W Publisher process 120 includes a composite signal builder 418 which builds a composite 

compressed digital product signal with blank watermark 420, which in turn is sometimes referred 
|g to as composite signal 420. Composite signal builder 41 8 is shown in greater detail in Figure 5. 
O Composite signal builder 418 includes two frame selectors 502 and 504. Composite 

kQ signal 420 is compressed by composite signal builder 4 1 8 using a type of frame-based 
20 compression. Accordingly, analogous frames of both logical streams are selected by frame 

selectors 502 and 504. The selected frames are received by a composite frame builder 506 which 
builds composite frames 512 from a logical "1" frame from frame selector 502 and a logical "0" 
frame from frame selector 504. Composite frame builder 506 builds composite frames 512 such 
that all possible watermark data configurations can be coded from composite frames 5 12 as 
25 described more completely below. 

To build composite frames 512, composite frame builder 506 is cognizant of segment 
boundaries used by segment windowing logic 410 (Figure 4). In particular, composite frame 
builder 506 (Figure 5) includes watermark segment logic 508 which determines segment 
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boundaries in the same manner employed by segment window logic 410 (Figure 4). In addition, 
composite frame builder 506 (Figure 5) applies frame-based compression using a frame 
compressor 510. 

*€bmpflrmo fram e hu Udf^SOfi^nr^irt ^m fi jimi - a 11 r » n onm-Hing tn IngiV flm^ 

diagrapa'oOO (Figure 6). Processing according to logic flow diagram 600 is further illustrated in 

In step 602 (Figure 6), composite frame builder 506 (Figure 5) determines which 
segments of the logical streams overlap the current frame. The current frame is the frame which 
has been received from frame selectors 502 and 504 and has not yet been packed into a 
composite frame. It is appreciated that, using concurrent processing techniques, more than one 
frame can be current. However, for simplicity, one frame is considered current at one time. In 
Figure 7, the current frame is frame 702, which overlaps segments 1A-C of the logical "1" stream 
and segments 0A-C of the logical "0" stream. 

Jn- step 004 (Figure 6), cpifip o site frame buil der- 506 (Figure 5) forms-all p cm i uU Uiuus of 
the corresponding segmente/<5f the two streams. For example, composite frame builder 506 
forms frame permutatk>*is 704 which include a separate frame permutation for each possible 
combination of w^rmark data that can be represented in segments 1 A-C and 0A-C. For 
example, frame permutations 704 represent, from top to bottom, the following logical bit stream 
segments^ watermark data: "1 11," "1 10," "101," "100," "011," "010," "001," and "000." All 
of frajrfe permutations 704 are eventually represented in composite frame 710, which is included 
i ^ u iuposile frames 516 (Figure 5) t 

It is possible that different frames received from frame selectors 502 and 504 will overlap 
different numbers of segments. For example, a subsequently received frame might overlap only 
two segments. Frame permutations 704 are equal in number to 2" where n is the maximum 
number of segments which can overlap a frame. In this illustrative example, the maximum 
number of segment which can overlap a frame is three. Accordingly, there are eight frame 
permutations 704. 

When a frame overlaps fewer than the maximum number of segments, the frame 
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permutations are repeated to form eight frame permutations 704. Specifically, the four possible 
frame permutations would represent the following logical bit stream segments of watermark data: 
"11," "10," "01," and "00." By repeating these permutations, frame permutations 704 would 
represent the following logical bit stream segments of watermark data: "11," "10," "01," "00," 
5 "11 ," "10," "01," and "00." Thus, the appropriate frame permutation can be selected later by 
reference to only the two least significant bits of a three-bit logical watermark data window. 

In step 606 (Figure 6), composite frame builder 506 (Figure 5) selects compression 
parameters for all frame permutations 704 (Figure 7). Since basis signal 404 (Figure 4) has low 
energy relative to subject digital product signal 402, the two logical streams, and therefore frame 

10 permutations 704 (Figure 7) are not terribly different from one another. Accordingly, 

fe% compression parameters which are relatively optimum for all frame permutations 704 can be 
determined. In one embodiment, optimum compression parameters are determined for each 

m individual one of frame permutations 704 and are averaged to provide a single set of compression 
parameters for the entire group of frame permutations 704. The compression parameters include 

IS quantization parameters in this illustrative embodiment. 

r In step 608 (Figure 6), composite frame builder 506 (Figure 5) compresses all frame 

^ permutations 704 (Figure 7) using the compression parameters determined in step 606 (Figure 6). 
□ The results are compressed frames 706 (Figure 7). Frame-based compression used in step 608 
:fl (Figure 6) is conventional and can be, for example, the Advanced Audio Coding (AAC) frame- 
26 based compression. 

In step 610 (Figure 6), a composite frame packer 708 (Figure 7) of composite frame 

builder 506 (Figure 5) packs compressed frames 706 (Figure 7) to form composite frame 710. 

Step 610 (Figure 6) is shown in greater detail as logic flow diagram 610 (Figure 8). 

In step 802 (Figure 8), composite frame packer 708 (Figure 7) determines the total 
25 number of compressed frames 706 to be represented in composite frame 710. This number is 

typically predetermined and does not change. In this illustrative example, the total number of 

compressed frames 706 is 2 n where n is the maximum number of segments which can overlap a 

frame, i.e., eight (8) for example. 
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hrstcp-Se ^ ( Fig u re 8)j co mp osi t e fram e park f ^l Q&jl^^ the^tramB ggoE- 
unique ones of compressed frames 706. Comprised frames 706 can include equivalent 
compressed from either (i) replication of frajrfe permutations formed in the manner described 
above with respect to step 604 (Figure 6)/or (ii) compression of portions of subject digital 
product signal 402 (Figure 4) with supn low energy that any watermark signal is so slight as to be 
non-existent. Coding of a waterm^k signal in a portion of subject digital product signal 402 
with low energy can introduc^audible effects to subject digital product signal 402. Mechanisms 
which enable a watermarie'signal to survive such low-energy portions are described in the '936 
Application and that/iescription is incorporated here by reference. Low energy portions of 
subject digital product signal 402 can result in suppression of a watermark signal to such a 
degree that ty*o or more of compressed frames 706 representing different watermark data can be 
equivalent and indistinguishable. Composite frame packer 708 recognized equivalency of such 
confessed frames in addition to those which are equivalent through frame permutation 
^etitiorLrf ssSPbod o bover- 

In step 806 (Figure 8), composite frame packer 708 (Figure 7) maps frame indices of 
composite frames to corresponding ones of the unique compressed frames recognized in step 804 
(Figure 4). 

In step 808, composite frame packer 708 (Figure 7) includes the following in composite 
frame 710: the number of compressed frames 706 determined in step 802 (Figure 8), the number 
of unique compressed frames determined in step 804 5 data representing the mapping determined 
in step 806 5 and the unique compressed frames determined in step 804. Thus, representation of 
equivalent frames is avoided and composite frame 710 (Figure 7) is relatively compact. 

Further reduction in the size of composite frame 710 is achieved as a result of using a 
single set of compression parameters in forming compressed frames 706. In particular, a 
compressed frame typically includes data representing at least some of the compression 
parameters used for compress the frame. By using the same compression parameters in forming 
compressed frames 706, those compression parameters can be represented only once within 
composite frame 710. 
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Composite frame 710 includes multiple representations of a single compressed frame, 
each one corresponding to different watermark data. The number of multiple representations can 
be minimized by aligning segment boundaries with frame boundaries as illustrated in Figure 9. 

In this illustrative embodiment, frame compressor 510 (Figure 5) implements the known 
AAC data compression algorithm which uses frames of 2,048 samples each. In addition, the 
frames overlap by 50%, i.e.,. by 1,024 samples. Figure 9 is illustrative. For example, frames 
904 A-E each include 2,048 samples and overlap adjacent frames by 1,024 samples. 

To minimize the number of alternative frame representations to be stored in composite 
frame 710 (Figure 7), segment size is selected to be an integer multiple of the frame size and 
segments are aligned along frame boundaries. For example, segments 902A-C are each 4,096 
samples in length. In addition, the boundary between segments 902 A-B is aligned with the 
boundary between frame 904B and the frame immediately preceding frame 904A. Similarly, the 
boundary between segments 902B-C is aligned with the boundary between frame 904D and the 
frame immediately following frame 904E. The result is that frames 904B-D can each be 
represented by only two unique compressed frames within a composite frame such as composite 
frame 710 (Figure 7). Frames 904A (Figure 9) and 904E can each be represented by only four 
unique compressed frames. Accordingly, composite frame 710 (Figure 7) is about 2.5 times as 
large as a single, watermarked, compressed frame, ignoring improvements achieved by 
recognizing equivalent frames and by encoding compressing parameters only once as described 
above. Since compression of some signals, such as audio signals, can achieve reductions in 
storage requirements by as much as 90-95%, computer and network resources required to transfer 
resulting composite signal 420 (Figure 4) from publisher computer system 102 to server 
computer system 104 is still greatly reduced relatively to transferring uncompressed signals. 

Alignment of frame and segment buuudaiies results in an additional - improvomon t^ 
Compressed frames, such as frape 904A, tend to have higher energy toward the center of the 
compressed frames. Accordklgly, the energy of frame 904A is higher in the center of frame 
904A than at either end.Xs described above and in the '936 Application, segment windowing 
logic 410 (Figure 4) tapers basis signal 404 at segment boundaries to prevent audible effects at 
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basis signal boundaries. It should als^b^noted that, aside from the basis signal, the two 
alternative signals, namely, th^Wgical "0" stream and the logical "1" stream, are identical. 
Accordingly, at the bourjd^ry between segments 902A and 902B, the two alternative signals are 
nearly identical. Thtfs, the energy of frame 904A is highest at a point at which the alternative 
signals are nxfst identical. As a result, the likelihood that alternate versions of frame 904A are 
equivajtfm is improved and the number of unique versions of frame 904A can be reduced 
Tfymini; rini^vm more rompart reprrsentntfmh 

The processing by blank watermarker 406 (Figure 4) and composite signal builder 41 8 of 
publisher process 120 also greatly reduces the amount of work required of quick watermarker 
144, which is shown in greater detail as quick watermarker 144B (Figure 10) in this embodiment. 

Quick watermarker 144B retrieves composite signal 420 from digital product datastore 
142 (Figure 1). In particular, quick watermarker 144B (Figure 10) processes a single composite 
frame 1004 at a time. It is appreciated that parallel and concurrent processing techniques can be 
used to process multiple composite frames concurrently; however, processing of a single 
composite frame at one time is described for simplicity. 

Quick watermarker 144B includes transaction identification data 1008 which is relatively 
unique to a particular transaction in which server computer system 104 (Figure 1) delivers a 
specific copy of the subject digital product signal to client computer system 106. Transaction 
identification data is sufficiently unique to identify this particular transaction and to identify 
client computer system 106 as the particular computer system to which the subject digital product 
signal is delivered. In a subsequent delivery of the same subject digital product signal, 
transaction identification data 1008 (Figure 10) would be different to identify the subsequent 
transaction. Thus, quick watermarker 144B does not know the specific value of transaction 
identification data 1008 until a specific user has requested the subject digital product signal. 

r A wat c rmark -data-b it s tre ana-geire fator 1010 -e fquick wd termarke i 144D g e n omi cs a - 
stream of watermark data bits from te&isaction identification data 1008 in the manner described 
above with respect to bit stream generator 306 (Figure 3) except that segments of a basis signal 
are unnecessary and tapering pi the basis signal at segment boundaries is also unnecessary since 
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both segments and segment bounjiafy tapering has been performed by segment windowing logic 
410 (Figure 4) of publisherpfocess 120 in the manner described above. Watermark data bit 
stream generator 10K)^e-codes, convolutionally encodes, and cyclically scrambles transaction 
identification daJd'iOOS to reduce the likelihood that the resulting watermark can be detected, 
5 decoded, and/or removed without proper authorization. The pre-coding for inversion robustness, 
convolutional encoding, and cyclical scrambling are all described more completely in the '936 
A^flcaliuiian d that de s cription io in corporated her ein by lefeieuce ^- 

The watermark data generated by watermark data bit stream generator 1010 determine 
which of the alternative frame representations of composite frame 1004 is selected to be included 
10 in a resulting compressed, watermarked signal. Frame selection is performed by a frame selector 
^ 1006 of quick watermarker 144B. Frame selector 1006 is shown in greater detail in Figure 1 1 . 
?fl Frame selector 1006 includes a composite frame parser 1 102 which parses composite 

jg frame 1 004 to produce a mapper 1 1 04 and unique frames 1 1 06. Unique frames 1 1 06 are the 

unique compressed frames included in composite frame 1004 as described above. Mapper 1 104 
|§ receives a frame number and maps the frame number to an index into unique frames 1 106. 

Frame selector 1006 also includes segment logic 1110 which keeps track of segment 
boundaries as composite frames are processed. In particular, if composite frame 1004 represents 
13 one or more segments not represented in previously processed composite frames, a new bit from 
ijg the watermark data bit stream of watermark data bit stream generator 1010 (Figure 10) is shifted 
10 into a shift register 1112 (Figure 1 1) for each such new segment. The new watermark data bits 
are shifted in, in sequence, as new least significant bits. Shift register 1 1 12 has a length equal to 
the maximum number of segments which can overlap any composite frame. 

Consideration of the example of Figure 9 facilitates understanding and appreciation of the 
operation of frame selector 1006 (Figure 10). Upon receiving frame 904A (Figure 9), segment 
25 logic 1110 (Figure 1 1) determines that a new segment, i.e., segment 902B (Figure 9), is 

represented by frame 904 A. The previous least significant bit of shift register 1112 (Figure 1 1) 
represented the watermark data bit for data to be encoded in segment 904A (Figure 9). Segment 
logic 1110 (Figure 1 1) causes another bit of the watermark data bit stream, e.g., one representing 
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a watermark data bit corresponding to segment 902B (Figure 9), to be shifted into the least 
significant bit of shift register 1112 (Figure 11). Such shifts the previously least significant bit to 
the next more significant position within shift register 1112. In the illustrative example of Figure 
9, the most segments overlapped by a single frame, and therefore the length of shift register 1112 
(Figure 11) is two. 

Thus, after shifting by segment logic 1 1 10, the two bits stored in shift register 1112 
represent the watermark data to be encoded in segments 902A-B. Mapper 1 104 (Figure 1 1) reads 
shift register 1112 and provides an index into unique frames 1 106 according to the value of the 
bits of shift register 1112. The unique frame selected by selector 1 108 according to the index 
provided by mapper 1 104 represents encoding of the watermark data bits of shift register 1112 
and is appended to a stream of selected frames. The stream of selected frames collectively form 
a compressed digital product signal which is watermarked according to transaction identification 
data 1008 (Figure 10). 

Next, in this illustrative example, frame selector 1006 processes frame 904B (Figure 9). 
Segment logic 1110 (Figure 1 1) determines that no new segment is represented by frame 904B 
and does not shift any new watermark data bits into shift register 1112. Thus, shift register 1112 
contains the same data used to process frame 904A (Figure 9). However, there are only two 
possible segment combinations that can be represented within frame 904B. As described above 
with respect to composite signal builder 418 (Figure 4) and step 604 (Figure 6), frame 
permutations are duplicated as necessary to create a maximum number of frame permutations. In 
the example of Figure 9, the maximum number of frame permutations is four since a frame can 
represent at most two segments. Thus, in forming a composite frame representing frame 904B, 
composite signal builder 418 replicates frame permutations to make four frame permutations. In 
particular, composite signal builder 418 makes frame permutations representing a portion of 
segment 902B with a logical "1" encoding and representing a portion of segment 902B with a 
logical "0" encoding. Composite signal builder 418 (Figure 4) uses the logical "1" frame 
permutation to jepresent watermark data of shift register 1112 (Figure 1 1) having values of "1 1" 
and "01," i.e., with a least significant bit value of "1." Similarly, composite signal builder 418 
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(Figure 4) uses the logical "0" frame permutation to represent watermark data of shift register 
1112 (Figure 1 1) having values of "10" and "00," i.e., with a least significant bit value of "0." 
Thus, regardless of the most significant bit in shift register 1112 during processing by frame 
selector 1006* mapper 1 104 selects one of unique frames 1 106 according to only the least 
significant bit of shift register 1112. The effect is that watermark data corresponding to segment 
902 A (Figure 9) is ignored as a result of mapper 1 104 (Figure 1 1) mapping absolute frame 
reference numbers to an index within unique frames 1 106. 

The state of shift register 1 1 12 is not changed during processing of frames 904C-D 
(Figure 9). When frame 904E is processed, segment logic 1110 (Figure 1 1) determines that one 
new segment is represented by the current composite frame and shifts a new watermark data bit 
into shift register 1112. The watermark data bit corresponding to segment 902 A (Figure 9) is 
shifted out of shift register 1112 (Figure 11) and the two bits of shift register 1112 now represent 
segments 902B-C (Figure 9), the former corresponding to the most significant bit of shift register 
1112 (Figure 1 1) and the latter corresponding to the least significant bit. 

As frame selector 1006 processes composite frames in sequence, frame selector pieces 
together compressed, watermarked frames corresponding to logical "1" values or logical "0" 
values according to watermark data bits generated by watermark data bit stream generator 1010 
(Figure 10). The processing by frame selector 1006 is very efficient, requiring neither basis 
signal generation nor compression as the various packed unique frames are already watermarked 
with preselected values and compressed. 

The above description is illustrative only and is not limiting. The present invention is 
limited only by the claims which follow. 
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